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Adjusting Subpixel Intensity Values Based Upon Luminance 
Characteristics of the Subpixels in Liquid Crystal Displays 

Background of the Invention 



Field of the Invention 

The invention relates to liquid crystal displays (LCDs) and, more particularly, to 
improving the viewing angle characteristics of liquid crystal displays. 

10 Description of the Related Art 

Most modern liquid crystal display panels suffer from poor viewing angle characteristics 
(color shift and level reversal, as a function of viewing angle) over a range of subpixel intensity 
values between the bright and dark states. Of the various liquid crystal modes used in these 
displays, the most commonly used is the Twisted Nematic mode (TN mode), which has poorer 

1 5 viewing angle characteristics than other modes. Typically, a normally white mode is used, so 
that the fully bright state corresponds to a low applied voltage and the fully dark state 
corresponds to a high applied voltage. The display picture elements are commonly referred to as 
pixels, where each pixel usually consists of a group of three subpixels, namely red, green, and 
blue subpixels. Typical LCDs have a stripe pixel geometry, where the pixels are square in shape, 

20 and where all subpixels are shaped as vertical stripes with the height of a full pixel and width of 
one third of a full pixel. For the normally white mode, using 8-bit drive per color, the highest 
applied voltage corresponds to an intensity value of zero, and the lowest applied voltage 
corresponds to an intensity value of 255. Intensity values are also referred to as digital pixel 
levels, or digital to analog conversion values (DAC values). 

25 The poor viewing angle characteristics result from the variation in optical transmission at 

different angles as voltage is applied across the liquid crystal cell gap. At a viewing angle of 
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normal incidence to the surface of the display, the luminance increases with digital pixel level, 

roughly following a power law, generally referred to as a gamma curve. FIG. 1 is an idealized 

gamma curve illustrating the relationship between luminance and digital pixel level at normal 

incidence. At viewing angles away from normal incidence, the gamma curve becomes distorted. 

5 For a given digital pixel level, the luminance varies strongly with viewing angle. FIG. 2 shows 

the general trend of relative luminance variation over all viewing angles as a function of the 

digital pixel level. The variation in luminance has a non-monotonic dependence on pixel level, 

with the largest variation occurring over a range of pixel levels somewhere between the dark 

state and bright state. 

.10 U. S. Pat. No. 5,847,688 to Ohi et al. describes a technique that provides a new set of 

analog reference voltages to the data drivers every other frame. This requires additional, 
specialized circuitry to be added to the drive electronics for the panel. To work well, the method 
requires reference voltages for different gamma curves to be switched every two or more, frames. 
This is necessary to provide both positive and negative voltages sequentially to the pixel. If the 

15 frame rate is 60 Hz, the switching rate of the gamma curve would be 30 Hz or less. If the 

modulation in luminance between the two gamma curves is large enough, as required to improve 
the viewing angle characteristics, then flicker will occur. Human visual sensitivity to flicker 
peaks at about 10 Hz, and the sensitivity at 30 Hz is quite large. Alternatively, if the liquid 
crystal response speed is not fast enough to fully respond within two frame times, then the liquid 

20 crystal director will maintain an average position within the cell structure, and the luminance will 
not vary with time. The resulting luminance value will be the average of the two gamma curves, 
and no improvement in viewing angle characteristics will occur. 

U. S. Pat. No. 5,489,917 to Ikezaki et al. describes a technique whereby the reference 
voltage set is altered from the usual condition in that the lowest reference voltages are increased 

25 to suppress level reversal. For TN-mode LCDs with the usual rubbing and polarizer 
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configuration, this method improves the viewing angle characteristics in the upward direction 

(downward-looking) only. The level reversal condition is much stronger in the downward 

direction (upward-looking), so this method does not address the most noticeable deficiency in the 

vertical viewing angle characteristics. The method requires that the total range of reference 

5 voltages be decreased, which significantly reduces the dynamic range and contrast ratio of the 

panel. 

G. S. Fawcett and G. F. Schrack in "Halftoning Techniques Using Error Correction," 
Proceedings of the SID, Vol. 27/4, pp. 305-8 (1986), describes general algorithms for producing 
halftone images on any device, display, or printer which has limited grayscale capability. U.S. 

1 0 Pat. No. 5,254,982 to Feigenblatt et al. describes a halftone method with time-varying phase shift 
which was intended for LCDs with relatively few intensity grayscale values. The goal of both 
Fawcett et al and Feigenblatt et al. is to produce nearly continuous-tone images with devices 
which have limited grayscale capability. The present invention is intended for use with LCDs 
with full grayscale capability, and takes full advantage of this capability. Finally, the techniques 

15 of Fawcett et al. and Feigenblatt et al. do not provide a method to improve the viewing angle 
characteristics with the halftone process. 

In work done by both Honeywell and Hosiden Corporation, a split pixel structure has 
been used to increase the acceptable viewing angle range of TN-mode TFTLCDs. This work was 
described by Sarma et al. in "Active-Matrix LCDs Using Gray-Scale in Halftone Methods," SID 

20 Digest, pp. 148-150 (1989); Sarma et al. in "A Wide-Viewing-Angle 5-in.-Diagonal AMLCD 
Using Halftone Grayscale," SID Digest, pp. 555-557 (1991); Sunata et al. in "A 
Wide-Viewing-Angle 10-Inch-DiagonaI Full-Color Active Matrix LCD Using a 
Halftone-Grayscale Method," Int. Display Res. Conf. Record, pp. 255-257 (1991); Ugai et al. in 
"Deployment of Wide-Viewing-Angle TFT-LCDs Using Halftone Gray-Scale Method," 

25 Electronics and Communications in Japan, Pt. 2 5 VoL 80, No. 5, pp. 89-98 (1997). A summary 

3 
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of this work is also given in U. S. Pat. No. 5,847,688 to Ohi et al. In this technique, each 

subpixel is divided into two smaller split subpixels. An additional storage capacitor is utilized in 

combination with different load capacitances of the two split subpixels to provide a different 

pixel voltage to the two split subpixels. In this way, for a given subpixel voltage applied to the 

5 combination of two split subpixels, the transmission of the split subpixels is not the same. This 

technique is described by the authors as a "halftone gray-scale method." The method is halftone 

in the sense that one split subpixel is brighter than the other. Because the ratio of voltages 

applied to the split subpixels tracks as the ratio of the capacitances, the ratio of voltages will be 

approximately the same for all subpixel levels. For a given subpixel voltage, and different 

10 smaller-subpixel voltages, the transmission and viewing angle characteristics of the two small 
subpixels are not the same. By mixing together the light from the two smaller subpixels, the 
viewing angle characteristics are also mixed and improved as compared to a single subpixel. A 
major disadvantage of this approach is that a special subpixel structure is required within the 
array on the glass panel. To date, this technology has been successfully applied in aircraft cabin 

1 5 entertainment displays, containing subpixels as small as 1 59 by 477 microns. As the pixel area is 
decreased, the additional storage capacitance and split pixel structure become increasingly 
difficult to implement. This limits the extent to which this approach can be applied to computer 
information displays, in which both a large number and large density of pixels is required. For 
example, a display with 200 pixels per inch requires subpixel dimensions of approximately 42 x 

20 126 microns. 

Ogura, et al., in "A Wide-Viewing-Angle Gray-Scale TFT-LCD Using Additive 
Gray-Level Mixture Driving," SID Digest, pp. 593-596 (1992), describe a technique for 
improving the viewing angle characteristics of TFTLCDs by using additive gray-level mixture 
driving. In that work, pixels in odd columns are supplied with pixel voltages different from 
25 pixels in even columns. The voltage difference between columns is held at a constant value, 

4 
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slightly less than the threshold voltage of the liquid crystal material/ The technique requires a 

dual-bank data driver arrangement, in which alternate columns are connected to data driver chips 

above and below the array. Furthermore, the top and bottom banks of data driver chips must 

have different sets of reference voltages supplied to them. This approach was applied to a 

5 normally- white twisted-nematic o-mode LCD. It was found that the horizontal viewing range 

was increased by about 1 0 degrees. This paper contains the understanding that pairs of pixel 

columns can be combined to improve the viewing angle characteristics. One deficiency of the 

technique is that a special, on-glass configuration is required, namely a dual-bank configuration. 

The control electronics must also be modified to provide an extra set of reference voltages. 

1 0 Another problem is that a constant offset between column pixel voltages will not result in a 

luminance which for all levels matches the case where both columns have the same pixel voltage. 
This is a consequence of S-shaped transmission-voltage characteristics which are typical of all 
twisted nematic mode LCDs. Having a constant offset voltage which is independent of the input 
pixel data also causes problems with fine image patterns. A checkerboard or alternating-column 

1 5 kind of image pattern will not be properly rendered. For certain patterns in which pixel data 
correspond to the offset voltage, the pattern could either be twice as intense or may disappear 
altogether. 

Other techniques to improve the viewing angle characteristics of liquid crystal displays 
involve altered or special pixel structures, liquid crystal modes, or wiring within the panel array. 
20 Examples of other techniques include dual-domain TN-mode, multidomain vertical alignment 
(MVA) and in-plane switching (DPS). These techniques which require special structures within 
the glass panel are inherently more expensive to develop and manufacture than techniques which 
avoid special structures. The IPS mode generally requires more power in operation than the 
other modes. As such, these techniques have more general applicability to desktop monitors than 
25 to notebook computer displays. Furthermore, many of these approaches are generally not 

5 
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extendible to high density pixel arrays because special pixel structures require that a large 

fraction of the total available area be devoted to the purpose of viewing angle improvement. The 

remaining fraction limits the aperture area which can be achieved in a design as the pixel area is 

decreased. Complicated pixel structures are also difficult to manufacture with high yield. 

5 Thus, there remains a need in the art to provide an efficient and low cost mechanism that 

improves the viewing angle characteristics of modern liquid crystal display panels, especially for 

notebook computer displays. 

Summary of the Invention 

10 

The method and apparatus of the present invention provide a very low-cost way to 
improve the viewing angle characteristics of liquid crystal displays. The present invention 
provides an efficient mechanism to modify the intensity values (in digital form) of the subpixels 
of the display using dithering techniques that take into consideration the non-ideal luminance 

15 characteristics of the subpixels of the panel, thereby improving the displayed image by 

suppressing or eliminating level reversal and color shift over a wide range of viewing angles. 

According to the present invention, the data which is supplied to the panel is altered; 
therefore, it is not necessary to alter or change the liquid crystal cell, pixel structure, or glass 
panel, which are expensive and difficult to implement. The present invention can be 

20 implemented within the display subsystem, the data processing portion of the controller 

electronics within the display module, or operating system or application software. As the pixel 
density increases, the image quality and overall performance of this technique improves. Unlike 
other techniques which involve changes in physical pixel structure, this invention is easy to 
implement as the pixel density increases. This technique does not require special structures 

25 within the glass panel, and is intended for use with LCD's with full grayscale capability, and 
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takes full advantage of that capability, as well as the full dynamic range of the panel. In addition, 

image data containing text, line art, or other information can be preserved, as described in more 

detail below. Because only the data is altered, the method or apparatus can be controlled by the 

user, with the option of turning it off completely or altering the degree to which the viewing 

5 angle characteristics are changed. In this invention, both the luminance and color changes with 

viewing angle are reduced. 

The present invention not only improves viewing angle characteristics, it can also be used 

to improve color management and control by restricting the subpixel colors to a range having 

well-behaved states, without reduction in the number of renderable colors. 

10 This technique could be applied to any liquid crystal display which has viewing angle 

variations. Examples include thin-film-transistor liquid-crystal displays (TFTLCDs), otherwise 
known as active-matrix liquid-crystal displays (AMLCDs). The active thin film transistor 
devices which address the pixels in the array could be made of any material, such as amorphous 
silicon (a-Si), polycrystalline silicon (poly-Si), single-crystal silicon, or organic materials. The 

1 5 invention is also applicable to other kinds of liquid crystal display devices, such* as 
passive-matrix LCDs, otherwise known as super-twisted nematic liquid crystal displays 
(STNLCDs), and ferroelectric LCDs. 

In the method of generating an improved image according to the present invention, 
intensity values associated with the data elements of an image are modified to reduce the number 

20 of mid-tone intensity values between the bright and dark intensity values. Intensity values are 
modified according to the dependence of subpixel luminance on intensity and at least one 
viewing angle of the liquid crystal display. Intensity values are also modified according to other 
defined conditions on the data elements of the image. For example, if the data elements of a 
portion the image meet certain criteria, there is no modification of the intensity values. 
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In a preferred embodiment, a first plurality of entries providing an association between 

intensity value and luminance value for subpixels of an LCD display in at least one viewing 

angle direction are provided. In addition, a second plurality of entries providing an association 

between a target intensity value and intensity values outside the mid-tone intensity range axe 

5 provided. The intensity values are modified to reduce the number of mid-tone values by: 

generating a first luminance value from subpixel intensity values using the first plurality of 

entries for image data, identifying a target intensity corresponding to that luminance by using the 

first plurality of entries, and identifying intensities outside the mid-tone range by using the 

second plurality of entries. 

1 0 The preferred apparatus according to the present invention is a pixel data processor 

within the electronics of the display controller, implemented as part of an application-specific 
integrated circuit (ASIC) contained within the display panel module. The pixel data processor 
modifies intensity values associated with the data elements of an image to reduce the number of 
mid-tone intensity values between the bright and dark intensity values. Intensity values are 

15 modified according to the dependence of subpixel luminance on intensity and at least one 
viewing angle or range of viewing angles of the liquid crystal display. 

The above and other features and advantages of the present invention will be apparent 
from the following description of preferred embodiments of the invention with reference to the 
accompanying drawings . 

20 

Brief Description of the Drawings 

FIG. 1 is a graph illustrating the idealized dependence of luminance on digital pixel level 
intensity values, at a viewing angle of normal incidence. 
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FIG. 2 is a graph illustrating the relative luminance variation over a range of viewing 

angles as the intensity value decreases from the bright state to the dark state. 

FIG. 3 is functional block diagram of a computer system in which the present invention 

may be embodied. 

5 FIG. 4 is a functional block diagram of the display subsystem of FIG. 3. 

FIG. 5 is a functional block diagram of the Display Controller and Display Array of FIG. 

4. 

FIG. 6 is a graph of the detailed characteristics of luminance on intensity level. 
FIG. 7 is a polar plot of luminance of a TN-mode TFTLCD for level 255 . 
1 0 FIG. 8 is a polar plot of luminance of a TN-mode TFTLCD for level 0. 

FIG. 9 is a graph showing the luminance of a TN-mode TFTLCD in the vertical plane. 
FIG. 10 is a graph of luminance versus digital pixel level from FIG. 9 at a vertical viewing angle 
of 62 degrees below normal incidence. 

FIG. 1 1 is a graph of differential contrast ratios versus vertical viewing angle. 
15 FIG. 12 is a graph of the yellow-blue shift of a typical TN-mode TFTLCD for uniform 

gray with R=G=B. 

FIG. 13 is an illustration of pixel polarities used in row inversion. 
" FIG. 14 is an illustration of pixel polarities used in dot inversion. 
FIG. 15 is an illustration of a full pixel 2x2 pattern, with dot inversion. 
20 FIG. 1 6 is an illustration of a full pixel 2x4 pattern. 

FIG. 17 is an illustration of a full pixel 4x2 pattern. 

FIG. 1 8 is an illustration of a 4x2 double subpixel pattern. . 

FIG. 19 is an illustration of a 2x2 subpixel pattern with a green/magenta arrangement. 
FIG. 20 is an illustration of a 14x14 staggered subpixel pattern, with a majority of bright 
25 subpixels. 

9 
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FIG. 21 is an illustration of a 14x14 staggered subpixel pattern, with a majority of dark 

subpixels. 

FIG. 22 is a general flow chart of halftone pixel processing. 
FIG. 23 is a flow chart for full pixel 2x2 pattern. 
5 FIG. 24 is a flow chart for double subpixel 4x2 pattern. 

FIG. 25 is a flow chart for 2x2 subpixel pattern, where pixels are processed within the 
same column. 

FIG. 26 is a graph illustrating a linear halftone relationship for ideal gamma 
characteristics. 

10 FIG. 27 is a graph illustrating a power-law halftone relationship for ideal gamma 

characteristics. 

FIG. 28 is a graph showing improved linear halftone relationship for lookup table for 
typical TN-mode panel transfer characteristics. 

FIG. 29 is a graph showing luminance versus viewing angle for different linear halftone 

15 curves. 

FIG. 30 is a graph illustrating a linear-law algorithm for 2x2 quad pixel processing, with 
maximal separation between light and dark branches. 

FIG. 31 is an illustration of a 2x2 subpixel-like pattern for 25% luminance using quad 
pixel processing. 

20 FIG. 32 is an illustration of a 2x2 subpixel-like pattern for 75% luminance using quad 

pixel processing. 

FIG. 33 is an illustration of a 4x2 double subpixel-like pattern for 25% luminance using 
quad pixel processing. 

FIG, 34 is an illustration of a 4x2 double subpixel-like pattern for 25% luminance using 
25 quad pixel processing. 

10 
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Description of the Preferred Embodiments 



The overall architecture of an exemplary system that embodies the present invention is 
depicted in FIG. 3. As shown, a computer system 100 includes a processor 102 which is 
5 operatively coupled to system memory 104 and other components via a system bus 106. The 
system memory 104 includes random access memory that stores the operating system of the 
computer system 100 and application software, if needed. For the sake of description, the system 
bus 106 is shown as a single bus; however, it is readily apparent to one skilled in the art that the 
system bus may comprise one or more buses (which may utilize different bus protocols) 

10 depending upon the architecture and design of the computer system 100. For example, the 
system bus 106 may include a plurality of buses organized in a hierarchical manner as is typical 
in modern Intel-based architected systems. The operating system and application software are 
typically loaded into the system memory 104 from persistent storage 109, such as a fixed disk 
drive or other nonvolatile memory. In addition, the operating system and application software 

15 may be loaded into system memory 104 from network resources via a communication adapter 
(not shown) such as a modem, a local area network adapter network, a wide area network adapter 
or other communication device. Input/output (I/O) devices 108 operatively couple to processor 
102 via the system bus 106. The I/O devices 108 may include a keyboard, template or touch pad 
for text entry, a pointing device such as a mouse, trackball, or light pen for user input, and speech 

20 recognition for speech input. 

The operating system controls the allocation and usage of the hardware resources of the 
computer system 100, and is the foundation on which the application software is built. The 
application software works in conjunction with the operating system and user input to perform 
specific tasks. Examples of application software include a word processor, spreadsheet program, 

25 web-browser, video player, 3-D modeling and navigation software, 3-D game software, etc. 

11 
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The computer system 100 includes a display subsystem 110 that interfaces to the 

processor 102 and the system memory 104 via the system bus 106. Generally, the display 

subsystem 110 operates to generate images for display on the display device 112 based upon 

commands generated by the processor 102 and transferred to the display subsystem 1 10 via the 

5 system bus 106. 

The operating system includes an implementation of a programming interface 
(hereinafter "graphics programming interface") that is used by other parts of the operating system 
and application software to transfer commands and data to the display subsystem 1 10 in order to 
. generate images for display on the display device. More specifically, the operating system and/or 

10 application software works in conjunction with the graphics programming interface to load data 
(such as text data, bit-map pixel data, and three-dimensional graphics data) into system memory 
104 in a form suitable for use by the display subsystem 1 10. In addition, the operating system 
and/or application software works in conjunction with the graphics programming interface to 
generate commands associated with the data in a form suitable for use by the display subsystem 

15 110, and transfers the commands to the display subsystem 1 1 0 via the system bus 1 06. The 
display subsystem 110 performs the operations dictated by the commands to generate image data 
for display on the display device. The commands transferred to the display system may be, for 
example, a command to draw a line, a command to draw a window, a command to render a 
bit-map image, a command to render a three dimensional image, a command to decode a video 

20 stream, etc. The display device 1 12 may utilize raster scan techniques (such as a CRT display 
device) or array switching techniques (such as liquid crystal/TFT display device) to display the 
pixels. 

The display subsystem 1 10 of the present invention as described below may be 
implemented in hardware as, for example, a gate array or a chip set that includes at least one 
25 programmable sequencer, memory, integer processing unit(s) and floating point unit(s), if 

12 
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needed. In addition, the display subsystem 1 10 may include a parallel and/or pipelined 

architecture. In the alternative, the display subsystem 110 may be implemented in software 

together with a processor. The processor may be a conventional general purpose processor, a 

part of the host processor 102, or part of a coprocessor integrated with the host processor 102. 

5 An example of the display subsystem 1 10 is shown in FIG. 4. More specifically, the 

exemplary display subsystem 1 10 includes a control processor 200 (not shown) that supervises 

the operations performed by the other elements of the display subsystem 1 10. The display 

subsystem 110 attaches to the system bus 1 06 via a host interface 202, which reads and writes 

data from and to the system bus 106 by performing the communication protocol of the system 

10 bus 106. 

The display subsystem 110 includes display logic 204 that performs the operations 
dictated by the commands received via the system bus 106 to generate image data for display on 
the display device 1 12. The display logic 204 may include a microprocessor or may include 
special purpose hardware for performing a specific class of operations. 
1 5 The image data generated by the display logic 204 is stored in a frame buffer 206 under 

control of a memory controller 208. In addition, the contents of the frame buffer 206 can be read 
back and transferred to the system control processor 102 via the memory controller 208 and host 
interface 202, 

The frame buffer 206 typically contains sufficientniemory to store color data (in digital 
20 form) for each pixel of the display device 1 12. Conventionally, the color data consists of three 
sets of bits (for example, 3 8-bit integers) representing red, green and blue (r 5 g,b) colors for each 
pixel. Conventionally, the frame buffer 206 is arranged in a matrix of rows and columns each n 
bits deep wherein the particular row and column address corresponds to the pixel location on the 
display device 112. In addition, the display subsystem 1 10 may include two frame buffers. In 
25 the conventional system, one of the frame buffers serves as the active display portion, while the 

13 
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other frame buffer is updated for subsequent display. Either frame buffer may change from being 

active to inactive in accordance with the needs of the system 100; the particular manner in which 

the changeover is accomplished is not relevant to the present invention. 

The display subsystem 1 10 also includes video timing logic 214 that generates video 
5 timing signals that control the transfer of pixel data from the frame buffer 206 to the display 
device 112. More specifically, the video timing logic 214 generates a pixel clock signal, a 
horizontal synchronization signal (or HS YNCH signal) and a vertical synchronization signal 
(VSYNCH). The pixel clock signal represents the transition between pixels in a given line of the 
display. The HSYNCH signal represents the transition from one line to another line of the 
10 display device, and the VSYNCH signal represents the transition from one frame (i.e., the last 
line of a frame) to the next frame (i.e., the first line of the next frame) of the display device. 

The video timing signals are provided to memory controller 208, which generates an 
address signal based upon such video timing signals supplied thereto. The address signals 
generated by the memory controller 208 are provided to the frame buffer 206 to cycle through the 
1 5 pixel locations of the frame buffer 206. In each address cycle, the pixel data for one or more 
pixels is read from the frame buffer 206 and transferred to a palette DAC 220. 

The palette DAC 220 maps the pixel data output from the frame buffer 206 to a color 
space (which, for example, may be a 24 bit integer value) used on the display. Preferably, the 
palette DAC 200 utilizes a table look-up that operates synchronously with the pixel clock signal 
20 generated by the video timing logic 214. 

In computer systems (e.g., desktop computer systems), the palette DAC 220 forwards the 
transformed pixel data to a video encoder 230 that encodes the transformed pixel data into a 
video signal, such as an NTSC signal, MPEG video signal or HDTV signal, for output to a video 
device 112-1, such as a CRT monitor. The video device 112-1 includes a decoder, display 

14 
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controller and a display that decodes the video signal and displays the image represented by the 

pixel data encoded therein. 

In some computer systems (e.g., notebook computers), the palette DAC 220 forwards the 

transformed pixel data, typically one pixel at a time, to a serial link transmitter 222. The serial 

5 link transmitter 222 receives the pixel data, serializes the pixel data into a bit stream, and 

transfers the bit stream to a display module 1 12-2 over a high speed serial channel. The display 

module 1 12-2 includes a serial link receiver 224 that receives the bit stream. Preferably, the 

serial link transmitter 222 and receiver 224 operate synchronously with the pixel clock signal 

generated by the video timing logic 2 14. An example of the serial link transmitter 222 and 

10 receiver 224 is the DS90CR383/DS90CR284 channel link manufactured by National 

Semiconductor. In addition, the signals communicated between the serial link transmitter 222 
and receiver 224 preferably include a clock signal generated by the serial link transmitter 222 that 
is derived from the pixel clock signal generated by the video timing logic 214. The serial link 
receiver 224 utilizes the clock signal communicated between the serial link transmitter 222 and 

15 receiver 224 to reconstruct the pixel clock signal. For example, the clock signal communicated 
between the serial link transmitter 222 and receiver 224 may be the pixel clock signal stepped 

i 

down by a factor of 2 N (where N is an integer greater than of equal to 0). 

The serial receiver 224 recovers the pixel data from the serial bit stream, and forwards 
the pixel data to display controller 226. In addition, the serial link receiver 224 utilizes the clock 
20 signal communicated between the serial link transmitter 222 and receiver 224 to reconstruct the 
pixel clock signal, and forwards the pixel clock signal to the display controller 226. The display, 
controller 226 utilizes the pixel clock signal and pixel data received from the serial link receiver 
224 to generate signals supplied to a display array 228 to thereby generate an image for display. 
The display controller 226 utilizes a predetermined driving scheme (for example, row 
25 inversion, column inversion, or dot inversion) to generate the image for display. FIG. 5 

15 
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illustrates an exemplary embodiment of the display controller 226 and display array 228 of FIG. 

4. More specifically, the display controller 226 includes memory 301 for storing the pixel data 

forwarded by the serial receiver 224. Pixel processing circuitry 303 (which is typically embodied 

by a controller or a gate array) transforms the pixel data stored in memory 301 and outputs the 

5 transformed pixel data to the display array 228. The display array 228 includes a liquid crystal 

cell control circuit 3 10, a liquid crystal cell 3 1 8, and a backlight 324. The liquid crystal cell 

control circuit 310 includes, as panel driver components, an LCD controller LSI 3 12, a source 

driver 316 and a gate driver 314. The LCD controller LSI processes the transformed pixel data, 

including the pixel data clock supplied by receiver 224, which signals are received from the 

10 display controller 226, and outputs signals to the source driver 316 and the gate driver 314, 
including timing control signals generated from the pixel data clock. The source driver 316 
generates a gray scale signal (in analog form) corresponding to the supplied pixel data and 
outputs the gray scale signal (in analog form) on the appropriate data line of the display array. 
An example of the source driver 3 16 is the MPT57481 Source Driver manufactured and sold by 

15 Texas Instruments. Gate line driver 314 generates addressing signal(s) to activate appropriate 
subpixels of the display array in order to provide the gray scale signals (in analog form) supplied 
on the data lines to the appropriate subpixels of the display array. An example of the gate line 
driver circuitry 309 is the MPT57604 Gate Driver manufactured and sold by Texas Instruments. 
The backlight 324 illuminates the liquid crystal cell 318 from the back or the side. The backlight 

20 324 includes a fluorescent tube 320 and an inverter power source 322. The display controller 
226 may also be provided with a user interface 305, to allow the user to adjust, for example, the 
degree to which the viewing angle characteristics are changed. 

According to the present invention, the data sent to the display array is modified to 
enhance the viewing angle characteristics of the liquid crystal display. The data modification 

25 may be implemented in hardware within the display subsystem or, as is preferred, entirely within 
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the data processing portion of the controller electronics within the display module, or 
alternatively in operating system or application software. The software may reside on any 



medium readable by a computer system having a display, e.g. a disk, tape, CD, etc. 



The data modification scheme depends on the properties of the liquid crystal display, 



5 such as its luminance and viewing angle characteristics. Presently used liquid crystal displays 
have good viewing angle characteristics in the bright state. The viewing angle characteristics in 
the dark state may be poor, but because the luminance is relatively small, this does not affect the 
viewer's perception. For certain levels or ranges of luminance between the dark and bright 
states, the luminance deviates strongly from an isotropic or Lambertian distribution with viewing 

10 angle, and at certain viewing angles the luminance does not monotonically increase with pixel 
level. This adversely affects the image quality by causing color shift and contrast reversal. By 
suppressing these problematic mid-tone levels in favor of brighter or darker levels, the present 
invention achieves the desired luminance level for the viewer, but does so using display elements 
which have good viewing angle characteristics. The improvements in viewing angle 

1 5 characteristics are achieved concurrent withsome loss of image resolution. 

The subpixel luminance of a liquid crystal display roughly follows a power-law 
dependence on digital pixel level, sometimes referred to as the gamma characteristics or gamma 
curve. Ideally, the subpixel luminance versus input digital subpixel level follows the simple 
relationship given in Eq. 1 below. Ymax and Ymm are the maximum and minimum luminances at 

20 normal incidence to the display, and n is the pixel digital level, or DAC level. For a display with 
8-bit color, each subpixel has 256 levels, and the levels span the range from 0 to 255. A plot of 
this relationship is given in FIG. 6, for y = 3.0 and YmJYndn = 500. 



max 



- Tmin) • (n/255y 



Eq.(l) 



25 
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Many liquid crystal displays 'do not follow this relationship precisely, but instead exhibit gamma 

characteristics with an S-shaped curve, in which the maximum luminance occurs at a pixel level 

somewhat below level 255. An example of an S-shaped gamma curve for a typical liquid crystal 

display found in notebook computers is also shown in FIG. 6. Typical liquid crystal cells have 

5 transmission versus cell voltage characteristics, which are also S-shaped. It is often erroneously 

assumed that the S-shape of the transmission characteristics leads to an S-shaped gamma curve. 

The shape of the gamma curve is determined by the particular choice of relationship between 

pixel levels and drive voltages provided to the liquid crystal panel 

For most liquid crystal modes and pixel cell structures used in TFTLCDs, the luminance 

10 does not remain constant with viewing angle. Furthermore, as the pixel level is decreased from 
the bright state, the variation in luminance with viewing angle over a range of viewing angles 
becomes larger. Examples of polar plots of luminance versus viewing angle for a 
twisted-nematic mode TFTLCD are given in FIG. 7 and FIG. 8 for pixel levels 255 and 0, where 
all subpixels are the same value (R=G=B), i.e. the gray condition. Considering the range of 

15 characteristics exhibited over the entire range of pixel levels (0 to 255), at particular viewing 
angles, the luminance over a range of pixel levels can be excessively bright compared to the 
gamma curve at normal incidence, or excessively dark compared to the gamma curve. For some 
liquid crystal configurations, at particular viewing angles, the luminance relationship with pixel 
level can become reversed, that is, the luminance at lower pixel values can be brighter than the 

20 luminance at higher pixel values. This situation is referred to as level reversal, and images 
viewed at these angles with pixel values in this range exhibit reverse contrast. For 
twisted-nematic mode liquid crystal displays, all of these effects generally occur. For liquid 
crystal displays with wide-viewing-angle modes other than twisted-nematic, there are also 
variations in luminance (and color) with viewing angle, but those generally do not exhibit level 

25 reversal. 
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For twisted-nematic mode liquid crystal displays, the strongest variation in luminance 
occurs in the vertical direction, as the incident viewing angle is varied from below normal 
incidence to above normal incidence. An example of the luminance characteristics versus 
vertical viewing angle for a twisted-nematic mode liquid crystal display is given in FIG. 9, which 
5 consists of a family of curves corresponding to vertical cuts in polar plots of luminance at an 
azimuthal angle of 90 degrees. Positive values of viewing angle (theta) correspond to the upward 
direction from the panel normal (as viewed downward) and negative values of viewing angle 
correspond to the downward direction from the panel normal (as viewed upward). It is seen that 
as the pixel level is reduced from 255 toward 0, the luminance peak moves from a vertical 

10 viewing angle theta of zero to positive theta angles. As the incident angle increases above zero, 
the luminance curves become more closely spaced, and cluster together toward the highest pixel 
levels. The luminance behavior in this region is excessively bright. As the incident angle 
decreases below zero, the family of luminance curves retain most of their relative spacing, but 
the overall magnitude of the curves drops off much more sharply with incident angle than for the 

1 5 case of positive incident angles. The luminance behavior in this region is excessively dark. For 
the lowest pixel levels, as the viewing angle is made more negative, the luminance curves cross, 
corresponding to the level reversal condition discussed previously. For the very highest positive 
incident viewing angles and pixel levels, there can also be some level reversal. 

In FIG. 1 0, a plot of luminance versus pixel t level at a vertical viewing angle of -62 

20 degrees is shown for the data in FIG. 9. At this viewing angle, the luminance generally exhibits a 
local maximum, and does not follow a gamma-type relationship. The luminance is not 
monotonic, and peaks at a mid-tone gray level below the midpoint of the range of levels. This 
luminance can be viewed as an error function, with a maximum error for midrange pixel levels. ■ 
To examine the level reversal effect more closely, a plot of a family of differential 

25 contrast ratios can be constructed from the data in FIG. 9, as shown in FIG. 1 1 . The differential 
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contrast ratios are the ratio of luminances between selected pixel levels. In FIG. 11, several 

ratios of levels are shown. Ideally, the differential contrast ratio (CR') for two levels rti and n 2 

should follow from the gamma relationship: 

CR'^(m/n 2 y Eq.(2) 
5 In FIG. 11, it is evident that the differential contrast ratios do not follow this relationship. For 
incident viewing angles in the range 0 to +35 degrees, the differential contrast ratios remain 
relatively well behaved, reflecting the non-ideal gamma relationship typical of LCDs near normal 
incidence. For incident viewing angles in the range +35 to +80, the differential contrast ratios of 
the highest levels drops below 1 , indicative of level reversal. For incident viewing angles in the 

10 range of 0 to -80 degrees, the differential contrast ratio characteristics very strongly deviate from 
acceptable behavior. For the lowest pixel levels below level 3 1, the minimum differential 
contrast ratio reaches a value close to 1 for a vertical viewing angle of about -10 degrees. As the 
pixel level is increased, the minimum differential contrast ratio dips strongly below 1, and the 
location of the minimum ratio moves to larger negative incident viewing angles. The smallest 

15 differential contrast ratio occurs between levels 223 and 207 at an incident viewing angle of 
about -65 degrees. For levels higher than this, the differential contrast becomes larger than 1 for 
all vertical viewing angles between 0 and -80 degrees. It is clear from this plot, that for negative 
vertical viewing angles, a broad range of pixel levels between approximately level 3 1 and level 
223 exhibit undesirable level reversal characteristics. 

20 Similar transmission characteristics for twisted-nematic mode liquid crystals are shown as 

FIG. 2b and FIG. 3b in U.S. Pat. No. 5,489,917 to Ikezaki, et al., in which level reversal 
phenomena are exhibited in upward and downward directions dependent upon the exact liquid 
crystal mode. A general feature of the characteristics shown in FIG. 1 1 and in Ikezaki is that for 
a given set of viewing angle conditions and range of pixel levels, the luminance error associated 
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with level inversion peaks somewhere in the mid-tone graylevel region, that is for pixel levels 

somewhere between the minimum and maximum. 

Another aspect of most liquid crystal display modes is the color variation which occurs 

with pixel level. Typical characteristics of twisted-nematic mode are shown in FIG. 12, in which 

5 the chromaticity is plotted versus graylevel, for the condition that all three subpixels have the 

same level, R=G=B. The value u' is indicative of the eye's red-green response, where larger u' 

values correspond to larger red response. The value v' is indicative of the eye's yellow-blue 

response, where larger v 5 values correspond to larger yellow response. Over the range between 

fully bright (level 255) and fully dark (level 0 ) the change in v 1 is larger than u\ such that the 

10 chromaticity changes from yellowish at level 255 to bluish at level 0. This yellow-blue shift is 
typical of most liquid crystal display modes. For images which contain a significant number of 
bright pixels, the appearance of color occurs relative to the white state, which acts as a reference 
illuminant. The change-in chromaticity will be judged as a color shift toward the blue as the 
level is decreased. Provided the display has a large contrast ratio, that is, the luminance of the 

15 bright state is much larger than the luminance of the dark state, the color shift will be most 
noticeable for the mid-tone graylevels. The bluish condition of fully dark pixels near level 0 
cannot be discerned relative to white; they appear black because their luminance is sufficiently 
low. However, the bluish condition of mid-tone gray pixels can be discerned relative to white 
because luminance of the mid-tone graylevels is significant compared to fully bright pixel 

20 luminance. 

In the present invention, these undesirable effects are removed by decreasing the number 
of image pixel values which have mid-tone levels. This is done by processing pixel data values 
to produce a halftone image, in which one group of pixels is made brighter than the input values 
and another group of pixels is made darker than the input values. The pixel data values can be 
25 chosen in such a way that the luminance is locally preserved in the image. Both the bright and 
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dark pixels have more desirable viewing angle characteristics than the mid-tone gray pixels 

which would otherwise be present in the image. The viewing angle characteristics will be 

dominated by the bright pixels, which are much more visible than the dark pixels. In this way, it 

can be thought that the luminance viewing angle characteristics of a halftone image approaches 

5 that of the bright pixels, simply masked by the presence of dark pixels which reduce the overall 

luminance relative to the brightness of the individual bright pixels. 

A necessary constraint on the groups of pixels is that the group of bright subpixels must 

contain approximately equal numbers of positive and negative subpixels, as determined by the 

inversion method used to drive the panel To minimize flicker and image sticking phenomena, it 

10 is necessary to change the polarity of pixel voltages every subsequent frame. Furthermore, to 
further improve the image quality, including suppression of capacitive crosstalk effects, it is 
beneficial to alternate the polarity of pixels within the array. Frame inversion is defined to be the 
case that all pixels in the array are the same polarity within the same frame, alternating in 
subsequent frames. Column inversion is define to be the case that the pixel voltages alternate 

1 5 between columns within the array and also alternate between frames. Row inversion is the case 
that the pixel voltages alternate between rows within the array and also alternate between frames, 
as shown in FIG. 13. Dot inversion combines alternation of pixel voltage polarity with both row 
and column and between frames as shown in FIG. 14. Typically, at present, 
commercially-available notebook computer TFTLCDs are driven using row inversion, while 

20 present desktop monitor TFTLCDs are driven using dot inversion. 

. To satisfy the requirement that flicker is not observed, the bright subpixel voltages must 
be approximately evenly split between positive and negative values. The balance of positive and 
negative pixels should be matched, consistent with the ability of the human visual system to 
perceive flicker. The balance must be achieved over a region smaller than the minimal area over 

25 which the human visual system can perceive flicker, Other issues of image sticking and crosstalk 
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suppression also place requirements on balance of pixel voltages. All of the requirements are 

satisfied if the number of positive and negative pixels are balanced within a few percent, and the 

size of the region over which the balance is achieved is between 1 and 10 pixels. A wide range 

of halftone pixel patterns can be used which satisfy the inversion requirements, by nearly 

5 balancing the number of bright positive and negative pixels. The patterns can exactly balance the 

number of bright and dark pixels, in which 50% of the pixels are bright and 50% are dark, or 

some other ratio of bright and dark pixels, such as 66% dark pixels and 33% bright pixels. The 

simplest patterns are uniform over the entire panel image. The patterns could also be stochastic, 

adapting to the image content by changing frequency and pattern as regions of the image change. 

10 It should be understood that the intensity of the halftone patterns in different regions 

depends upon the image content in those regions. The patterns will have the same overall 
appearance only if the image content is changing gradually from pixel to pixel. If the image 
content is changing sharply from pixel to pixel, then the halftone pattern will be disrupted. To 
describe the different patterns, for the purposes of the following discussion, it is assumed that the 

15 image data is uniform from pixel to pixel, such as a mid-level gray color. 

Examples of uniform patterns are now described. One of the simplest patterns is a 2x2 
full pixel checkerboard, shown in FIG. 15. In this pattern, each full pixel, consisting of three 
subpixels R, G, and B is made either dark or bright. The full pixels alternate between dark and 
bright. Under row inversion, the polarities of all subpixels within each bright pixel are the same, 

20 the polarities alternate between rows, and the number of bright positive pixels are exactly 
matched by the number of bright negative pixels. This pattern is acceptable for panels driven 
under row inversion. However, under dot inversion, with polarities as shown in FIG. 15, it is 
seen that the number of bright positive and bright negative pixels is not balanced. 

Patterns which exactly balance the number of bright positive and bright negative pixels 

25 under both row inversion and dot inversion are shown in FIG. 16, FIG. 17, FIG. 1 8, and FIG. 19. 
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All patterns in these figures also share the property that exactly half the pixels are darkened and 

half the pixels are brightened. FIG. 16 illustrates a full pixel 2x4 pattern, in which the periodicity 

is 2 pixels in the horizontal direction and 4 pixels in the vertical direction. The brightened or 

darkened regions consist of a full pixel. FIG. 17 illustrates a full pixel 4x2 pattern, in which the 

5 periodicity is 4 pixels in the horizontal direction and 2 pixels in the vertical direction. The 

brightened or darkened regions consist of a full pixel. FIG. 18 illustrates a double subpixel 4x2 

pattern. The brightened or darkened regions consist of a pair of subpixels. FIG. 19 illustrates a 

subpixel 2x2 pattern. The periodicity is 2 pixels in both horizontal and vertical directions. The . 

brightened or darkened regions consist of either a single subpixel or a pair of subpixels. There 

10 are three possible color arrangements for the subpixel 2x2 pattern, namely green/magenta, 
red/cyan, and blue/yellow. The green/magenta color arrangement is depicted in FIG. 19. 

Examples of patterns with much larger repeat distances are shown FIG. 20 and FIG. 21 . 
These patterns can be described as staggered subpixel 14x14 patterns. These patterns have a 
periodicity of 14 full pixels in both the horizontal and vertical directions, with a total of 588 

15 subpixels in each repeated pattern. In FIG. 20, the bright subpixels constitute 57.1% of the total 
number of subpixels within the repeated pattern, with equal numbers of subpixels with opposite 
polarity. The dark subpixels constitute 42.9% of the total, also with equal numbers of subpixels 
with opposite polarity. The pattern shown in FIG. 21 is similar to that just described, except that 
the dark subpixels and bright subpixels constitute 57.1% and 42.9% of the total, respectively. 

20 From the description of these patterns, it is clear that many possible uniform patterns can 

be constructed which satisfy the required conditions for this invention. 

Most of these patterns can be created in the display image data by processing pairs of 
pixels within the same row in the image data, moving through the pixel data on a row by row 
basis. Some patterns may also require that pixels in adjacent rows be processed together. In that 

25 case, an entire line of pixel values must be stored in a line buffer. If a small number of pixels can 
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be processed together in groups with a small number of operations, the pixel data can be 

processed rapidly, at a rate compatible with refresh frame rates for the display. A description of 

pairwise pixel processing flow within the same row is shown in the flow chart in FIG. 22. 

FIG. 23 shows an example flow chart of how the pixel data could be processed for the 

5 2x2 full pixel checkerboard pattern shown in FIG. 15. The first step is to determine whether or 

not the first pixel in the row is to be skipped. If the pixel row is even, the first three subpixels are 

ignored, and the starting point is shifted by 1 full pixel within the row. If the pixel row is odd, 

retain the starting point at the 1st pixel in the row. Store the pair of subpixel level values in the 

row, starting at the pointer location and including the adjacent subpixel. Next, to preserve -line 

10 art and text which contain solid blocks of saturated colors, it is necessary to test for the presence 
of this material in the image data. If either subpixel is either level 0 or 255, the subpixel level 
values at this location remain unchanged by the algorithm. Alternatively, a threshold test could 
be used for the subpixels which prevents changing the pixel level values when the difference 
between input subpixel level values is larger than a threshold level value. A suitable threshold 

15 difference is about 100 levels. Next, the two values of pixel luminance are determined for the 
pair of pixel levels using a characterization lookup table (LUT). The characterization LUT is 
simply the calibration curve of the pixel luminance versus pixel level. If the panel characteristics 
- can be described by a simple mathematical relationship, then LUT #1 could be formula. The 
average luminance of the pair of pixels is then calculated. Next, using LUT #1 in reverse, the 

20 target average level is determined as that pixel level which corresponds to the average luminance 
of the pair of pixels. Finally, the two new DAC levels are then determined for the pair of pixels, 
using an algorithm LUT. The algorithm LUT is the halftone algorithm curve. The optimal 
halftone algorithm curve will be different for different calibration curves and different liquid 
crystal display technologies. 
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A different flow chart for the generation of the double subpixel 4x2 pattern in FIG. 1 8 is 

shown in FIG. 24. The general characteristics are the same as for the flowchart in FIG. 23, but 

with different branching conditions. Both of the flow charts in FIG. 23 and FIG. 24 involve 

processing pairs of pixel data within the same row in the image. An example of a flow chart 

5 which involves processing pairs of pixel data within the same column, but with different rows is 

given in FIG. 25. This flow chart describes the process generation of the 2x2 subpixel pattern 

shown in FIG. 19. 

For good performance of information displays, a gamma-type transfer curve, as described 
in Equation (1), is desired. Most commercial cathode-ray-tube displays have gammas in the 
1 0 range 2,2 to 2.8, and a gamma of 2.2 is generally the desired target value. We now consider the 
case that the display transfer characteristics follow a gamma-type curve, with a negligibly small 
minimum luminance, Y^. The transfer characteristics are then: 

Y= 7 max • (n/255y Eq .(3) 

For the following discussion, we consider a pattern in which exactly one half of the pixels are 
1 5 bright and one half are dark. We desire to match the macroscopic luminance of the halftone 
pattern to that of a uniform pattern. For a uniform pattern, in which all pixels have the same 
level, the microscopic pixel luminance is the same as the macroscopic luminance. The 
macroscopic luminance of the halftone pattern is given by: 

Yht- Y^max • C§j) 7 + i^max - (jt) 7 Eq. (4) 

20 where rid and rib are the levels of the dark and bright pixels in the halftone pattern. 

We first consider that the dark pixels are made as dark as possible, rid ~ 0, with negligible 
luminance. The macroscopic luminance of this halftone pattern will match the macroscopic 
luminance of a uniform pattern when the microscopic luminance of the individual bright pixels is 
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exactly twice that of the pixels of the uniform pattern. For a given target level of the uniform 

pattern, n , we have: 

Yht = {^max • (jss) V = ^max • (^s) Y Eq. (5) 
5 Solving for we obtain: 

n b = ri'(2) y y Eq.(6) 

Under these conditions, the relationship between halftone bright pixel level and target pixel level 
is linear. For purposes of illustration, the following example is provided. For y = 2.2, fib - 1 37n. 
Also, for y = 2.2, the uniform pattern luminance becomes V% Y max at a pixel level of 1 86. This 
10 luminance can be matched by a halftone pattern with equal numbers of fully bright pixels at level 
255 and fully dark pixels at level 0. 

For target levels larger than 186, the halftone bright pixels have saturated at level 255, 
and to match the target level luminance, the level of the dark pixels must be increased above 0. 

^max • ("255 ) y = Y = Yht = {^max • (^V + }^max • (Jff ) V Eq. (7) 

15 

The solution for the dark pixel levels becomes: 

/i rf = 255.[2.(^)J'-l] (1/y) Eq. ( 8) 

This relationship of bright and dark halftone pixel values to the target level, referred to as the 

linear algorithm, is shown in FIG. 26. An undesirable aspect of this algorithm is the presence of 

20 sharp corners in the curves for bright and dark pixel values, occurring near the point of 50% 

luminance. Images on liquid crystal displays processed with this algorithm typically exhibit 

luminance banding and strong color shifts for luminances near 50% of maximum. Through 

suitable functional modifications to the algorithm, the sharp corners in the curves can be 

smoothed. Examples of suitable functions include power-law and complementary error 
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functions. A power-law relationship has been explored experimentally,- and found to have 

reduced luminance banding and color shifts as compared to the linear algorithm. Although the 

maximum spread in bright and dark branches of the output DAC values is achieved with the 

linear algorithm, better results have been obtained with a power law algorithm. This power-law 

5 relationship is described next. 

We again consider a panel with ideal gamma-law transfer characteristics, as given in 

Equation 3. For a power-law relationship, a convenient way to define the dark branch of the 

halftone pixel pair is to define the dark pixel DAC value rid as a power law relationship to the 

target DAC value, w, with an exponent p, 

io ' n d '= 255 Eq.(9) 

so that the luminance of the dark subpixels, Ydark , is given by: 

= 7 max • Eq. (10) 

The sum of the luminances of the dark and bright pixels must equal the luminance of the target 
15 DAC value, normalized to take into account that each of the pixel pairs occupies one half of the 
surface area. 

27 = 27 max • (Ss) 7 = Ydark + Y bright = 7 max • (-gsY* + Y bright Eq. (11) 

Solving for Y b nghr : 

20 Y^ight 
Solving for rih : 



Ydark = Y l 



max 



255 



= rmax • [2( jfey - (-fey ] = r max • {jk) y m 
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If the power p = 1, then the bright and dark subpixel luminances are the same, that is, there is no 

halftoning. As the power p is increased the luminance of the dark subpixels is lowered, and the 

luminance of the bright subpixels is raised, following curves which can be called the dark and 

bright branches, respectively. If the power p is made too large, then for target DAC values near to 

5 255, the luminance of the dark branch is too small, such that the required luminance of the bright 

subpixels would exceed full brightness, at least for certain values of n> In this case, the 

maximum error occurs for DAC values somewhat below level 255. At present, there is no 

known analytical solution for the maximum value of p which will not result in any luminance 

error, but the value of p can be found numerically. For example, if y = 2.2, then the maximum 

10 value of p is 2.01. Further numerical study shows that the error increases quite slowly as p is 
increased beyond 2.01/ Since the viewing angle characteristics generally improve as the 
separation between bright and dark branches is increased, it is desirable to increase the value of 
p, as long as the luminance error introduced is acceptable. 

A summary of the error introduced for different values of p is shown in Table 1, for y = 

15 2.2. The range over which error occurs is shown, with the average value within that range, the 
maximum error and the DAC value at which the maximum error occurs. The human visual 
system can detect luminance 'differences of approximately 0.5 to 1.0%, for patches of light which 
are in close proximity. Without side-by-side comparisons, errors of up to several percent are 
probably acceptable, because the overall effect on the gamma curve transfer characteristics will 

20 not be noticeable in images. The average and maximum errors for p = 2.4 are about 1%, 
gradually increasing to between 3 and 4% for p = 3,0. Examples of light and dark branches of 
the power-law algorithm are shown in FIG. 27. 
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power 


error range 


avg error 


max error 


max error location 


2.01 


(none) 


0 


0 




2.1 


245-254 


0.0007 


0.0011 


250 


2.2 


237-254 


0.0026 


0.0038 


246 


2.3 


230-254 


0.0051 


0.0076 


243 


2.4 


225-254 


0.0083 


0.0121 


240 


2.5 ■ 


220-254 


0.0115 


0.0171 


238 


2.6 


216-254 


0.0149 


0.0223 


237 


2.7 


213-254 


0.0187 


0.0277 


235 


2.8 


210-254 


0.0223 


0.0332 


234 


2.9 


208-254 


0.0262 


0.0388 


234 


3 


205-254 


0.0294 


0.0443 


233 



Table 1 . Summary of power-law errors for y = 2.2. 



5 The errors can be suppressed by a suitable combination of linear algorithm and 

power-law algorithm DAC values. Specifically, the dark branch DAC levels can be the 
power-law values below the range in which error occurs, and linear algorithm values within the 
range where errors would normally occur with the power-law algorithm. 

As shown in FIG. 4, typical liquid crystal display panels do not exhibit ideal gamma-type 

10 transfer characteristics. The algorithms previously described can be applied to the non-ideal 
transfer characteristics, which will result in halftone image characteristics which are also 
non-ideal. This could be done by calculating all halftone pixel levels based on the known 
luminance values of the panel, instead of a formula based on ideal characteristics. In FIG. 28, an 
example of linear algorithm levels is shown, applied to a typical panel with non-ideal display 

1 5 transfer characteristics, such at that shown in FIG. 6. 

An alternative is to first modify the pixel data input to the panel to correct for the inherent 
non-ideal transfer characteristics, and achieve ideal gamma-law transfer characteristics. To do 
this, a gamma-correction LUT is constructed to change the input levels to new levels such that 
the output characteristics now follow an ideal gamma law characteristic. The gamma-correction 
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LUT can be combined with the algorithm LUT so that gamma correction and halftone algorithm 

generation are done in one operation. 

For target macroscopic luminances less than 50% of maximum, an upper limit for the 

luminances of the bright halftone pixels is easily established. Assuming negligible luminance of 

5 the dark state, for any target macroscopic luminance, the luminance of the bright pixels cannot 

exceed the target luminance by more than a factor of two. This follows simply as a consequence 

that the luminance of the dark halftone pixels cannot be smaller than zero. Taking into account 

nonzero luminance of the dark state, the theoretical upper limit for bright halftone pixel 

luminance is somewhat less than twice the target luminance. This condition establishes the 

10 maximum allowable separation between bright and dark branches of the halftone pixel levels. 

Experiments have shown that the best viewing angle characteristics are obtained when the 
difference between bright and dark branches of the curve are somewhat less than the maximum 
separation which is allowed. Reductions in color variation and pattern visibility also occur as the 
separation between the two branches is reduced. Semi-empirical methods can be used to 

1 5 establish several algorithm curves which optimize one aspect of the image quality or another. 
These curves may be user-selectable, In general, the curves will follow the shape of the curves in 
FIG. 26 or FIG. 27, with different degrees of separation between the bright and dark branches, 
and sharpness of the corners in the transition region near 50% luminance. 

FIG. 29 shows a plot of measured luminance versus vertical viewing angle characteristics 

20 of a TN-mode panel, for a 2x4 double subpixel halftone pattern, using a linear algorithm curve 
with maximum separation between the bright and dark branches, and pairwise pixel processing. 
The characteristics are shown for different target luminance values. As the target luminance is 
reduced from 100%, the viewing angle characteristics initially degrade from the white state 
condition, with the location of peak luminance shifting away from normal incidence. As the 

25 target luminance approaches 50% of maximum, the viewing angle characteristics return to the 
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white state condition, simply scaled from the 100% condition by a factor of two. This is 

expected, because the 50% luminance condition corresponds to one half the total number of 

pixels held in the fully bright condition, with the other half held fully dark. As the target 

luminance is further reduced below 50%, the luminance peak again moves away from normal 

5 incidence. 

All of the preceding discussion regarding the algorithm details applied to patterns in 
which exactly half of the pixels are darkened and half of the pixels are brightened in the halftone 
image. For patterns with proportions of bright and dark pixels other than this, the detailed 
algorithm must be altered accordingly. The preceding discussion was concerned with the 

1 0 calculation of halftone subpixel values which occur in pairs, that is, a dark subpixel and a bright 
subpixel. The subpixel pairs which are processed could be contained within the same row (a 2x1 
block) or within the same column (a 1x2 block). How the blocks of halftone subpixels are 
arranged into acceptable patterns was also discussed. 

If the pixel density in the array is large enough, approximately 170 pixels per inch or 

15 larger, then the viewing angle characteristics can be further improved, without a significantly 
noticeable reduction in image resolution, by processing 2x2 blocks of pixels, referred to herein as 
quad pixel processing. With quad blocks containing 4 pixels, the bright and dark subpixel 
luminance distribution can be refined. The average luminance of a quad block is calculated via 
the calibration LUT by adding up the 4 subpixel luminances and dividing by 4. The target level is 

20 also determined using the LUT in reverse. If all 4 subpixels were held at the target level, the 
luminance would match the average luminance of the original block of subpixels. If the average 
luminance is between 75% and 100% of maximum, then one of the 4 pixels in the block is made 
darker, while the remaining 3 pixels are held at or close to maximum brightness. If the average 
luminance is between 50% and 75%, then 1 pixel is fully or nearly fully dark, 1 pixel is in an 

25 intermediate state, and the 2 remaining pixels are held at or close to maximum brightness. If the 
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average luminance is between 25% and 50%, then 2 pixels are fully or nearly fully dark, 1 pixel 

is in an intermediate state, and the 1 remaining pixel is held at or close to maximum brightness. 

If the average luminance is between 0% and 25%, then 3 pixels are fully or nearly fully dark, and 

the 1 remaining pixel is at an intermediate state. 

5 An example of an algorithm for quad pixel processing is shown in FIG. 30, in which the 

separation between the light and dark branches of each of the four pixels is maximized. The 

curves correspond to a 5-column LUT in which for each target level, the digital pixel levels of 

each of the four pixels in the 2x2 block are specified. The order in which the four pixels are 

sequentially turned brighter or darker is determined by the pattern generation portion of the 

10 algorithm. This can be done by defining the four pixel locations in each 2x2 quad block as 

locations A,B,C, and D, as shown in Table 2. 



A 


B 


C 


D 



15 

Table 2. Pixel locations within each 2x2 quad block. 

Different patterns can be generated by specifying the order in which the subpixels within the 
quad block are turned on. As the target pixel level is increased from 0 to 255, for the individual 
20 red, green, or blue subpixels, charts showing the order in which the subpixels are turned on are 
given in Table 3 and Table 4. These turn-on sequences result in patterns which do not exhibit 
flicker, following the criteria discussed previously. Table 3 defines how the 2x2 subpixel pattern 
may be generated, and Table 4 defines how the 4x2 double subpixel pattern may be generated. 
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For example, the turn-on sequence for the red subpixels in the 2x2 subpixel pattern alternates 

between D,C,B,A and C,D,A,B for quad blocks in horizontal sequence. The turn-on sequence for 

the red subpixels in the 4x2 double subpixel pattern alternates between C,B,A,D and A,D,C,B for 

quad blocks in horizontal sequence. 



5 



location 


A 


B 


C 


D 


A 


B 


C 


D 


RED 


4 


3 


2 


1 


3 


4 


1 


2 


GREEN 


1 


2 


3 


4 


2 


1 


4 


3 


BLUE 


4 


3 


2 


1 


3 


4 


1 


2 



Table 3. Subpixel turn-on sequence to generate a 2x2 subpixel pattern. 
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location 


A 


B 


C 


D 


A 


B 


C 


D 


RED 


3 


2 


1 


4 


1 


4 


3 


2 


GREEN 


4 


3 ■ 


2 


1 


2 


1 


4 


3 


BLUE 


1 


4 


3 


2 


3 


2 


1 


4 



Table 4. .Subpixel turn-on sequence to generate a 4x2 double subpixel pattern. 

1 5 At 50% target luminance the subpixel patterns generated with this process match the 2x2 

subpixel pattern shown in FIG. 1 9 and the 4x2 double subpixel pattern shown in FIG. 1 8. 
Examples of the 2x2 subpixel pattern at 25% and 75% target luminance are shown in FIG. 3 1 
and FIG. 32. Strictly speaking, the patterns at 25% and 75% do not have perfect 2x2 subpixel 
symmetry as for the 50% luminance pattern, but they do maintain the same color character of this 

20 pattern. Examples of the 4x2 double subpixel pattern at 25% and 75% luminance are shown in 
FIG 33 and FIG 34. In similar fashion, these patterns do not possess perfect 4x2 double subpixel 
symmetry, but they do maintain the same color character of this pattern. 
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For the technique applied in 2x2 blocks, as the luminance decreases from maximum to 

minimum, the shifts in color and in viewing angle characteristics are about one half that 

exhibited by the technique applied to pairs of pixels.. This is a consequence of reducing the target 

luminance range spanned by each pixel by a factor of two. For pairwise pixel processing, as each 

5 pixel within the pair traverses luminance from bright to dark, the target average luminance 

changes by 50%. For quad pixel processing, as each pixel within the block traverses luminance 

from bright to dark, the target average luminance changes by 25%. In this way, the excursion of 

the peak luminance from normal incidence (as shown in FIG. 29) can be reduced by about one 

half, with corresponding improvement in viewing angle characteristics. 

1 0 From the earlier discussion regarding refinements in the algorithm for pairwise pixel 

processing, it should be recognized that further improvements in the appearance of the patterns 
resulting from quad pixel processing can also be achieved by appropriate smoothing or other 
modification of the curves illustrated in FIG. 30. For example, as the target luminance is 
increased, it is not necessary to fully turn on one pixel within the quad block before another pixel 

1 5 is turned on. In this way, the four curves shown in FIG. 30 can overlap, which will ameliorate 
the abrupt color and luminance changes which might otherwise occur near the boundaries of the 
four curves. 

For certain conditions met by the image data, it is necessary to turn off the halftone 
algorithm process. For example, if a portion of the image is black text on a white background, 
20 the halftone algorithm can be turned off by detecting the presence of a subpixel with level 255 or 
0. For processing of subpixel pairs, if either subpixel has a value of 0 or 255, then no 
modification is made to the subpixel data. Text or other portions of the image which contain 
fully saturated subpixels are not halftoned, and the local contrast between subpixels is preserved. 
Other criteria can be introduced, by testing for the presence of antialiasing or font smoothing. In 
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this way, the high contrast of letters can be preserved, and blocks of graphical images which 

contain saturated color can also be preserved. 

The present invention can be realized in hardware, software, or a combination of 

hardware and software. A preferred embodiment of this invention is implemented in hardware 

5 entirely within the data processing portion of the controller electronics within the display 

module. However, to one skilled in the art, it is clear that this invention can be implemented 

within the display subsystem hardware, operating system software or within the application 

software. 

The present invention can be realized in a centralized fashion in one computer system, or 
10 in a distributed fashion where different elements are spread across several interconnected 
computer systems. Any kind of computer system - or other apparatus adapted for carrying out 
the invention described herein - is suited. A typical combination of hardware and software could 
be a general purpose computer system with a computer program that, when being loaded and 
executed, controls the computer system such that it carries out the methods described herein. 
1 5 The present invention can also be embedded in a computer program product, which comprises ail 
the features enabling the implementation of the methods described herein, and which - when 
loaded in a computer system - is able to carry out these methods. 

Computer program means or computer program in the present context means any 
expression, in any language, code or notation, of a set of instructions intended to cause a system 
20 having an information processing capability to perform a particular function either directly or 
after either or both of the following a) conversion to another language, code or notation; b) 
reproduction in a different material form. 

While the invention has been particularly shown and described with respect to illustrative 
and preferred embodiments thereof, it will be understood by those skilled in the art that the 
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foregoing and other changes in form and detail may be made therein without departing from the 

spirit and scope of the invention as set forth in the claims. 
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We claim: 

1 . A method for generating an image for display on a display device having a 
plurality of subpixels, the method comprising the steps of: 

Providing, in digital form, luminance data which associates intensity values with 
5 corresponding luminance values characterizing luminance of said subpixels in at least one 
viewing angle direction for a range of said intensity values; 

providing a group of subpixel data elements representing color of a portion of said 
image, wherein each of said subpixel data elements comprises an intensity value; 

modifying said intensity values for said subpixel data elements in said group 
1 0 based upon said luminance data to reduce the number of said subpixels that have a luminance 
value in a range of mid-tone luminance values between a bright luminance value and a dark 
luminance value; and 

outputting said modified intensity values for said subpixel data elements of said 
group for display on said display device. 
15 2. The method of claim 1 , wherein the modifying step further comprises the 

sub-steps of: 

storing, in a first memory, a plurality of entries each providing an association 
between an intensity value and a corresponding luminance value characterizing luminance of said 
subpixels in at least one viewing angle direction; 
20 storing, in a second memory, a plurality of entries each providing an association 

between a target intensity value and a corresponding set of intensity values that are above and 
below said target intensity value; ' 

identifying particular luminance values stored in said first memory that 
correspond to intensity values of said subpixel data elements of said group; 
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generating a first luminance value based upon the particular luminance values 

stored in said first memory; 

identifying a first target intensity value stored in said first memory corresponding 

to said first luminance value; 

5 identifying a particular set of intensity values stored in said second memory that 

correspond to said first target intensity value; and 

modifying intensity values for said subpixel data elements in said group based 

upon said particular set of intensity values. 

3. The method of claim 2, wherein said subpixel data elements in said group are 
10 elements of full pixels which are adjacent to each other in said image. 

4. The method of claim 2, wherein the modifying step further comprises the step of: 
setting intensity values for said subpixel data elements in said group to said 

particular set of intensity values. 

5. The method of claim 2, wherein said first luminance value is derived by 

15 calculating an average luminance value of the particular luminance values stored in the first 
memory. 

6. The method of claim 1, wherein the modifying step further comprises the 
sub-steps of: 

evaluating said subpixel data elements for satisfaction of a set of predetermined 

20 criteria; 

modifying said intensity values if said criteria are not satisfied; and 
maintaining said intensity values if said criteria are satisfied. 

7. The method of claim 1 , further comprising the steps of: 
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performing a digital-to-analog conversion that converts the modified intensity 

values for said subpixel data elements of said group from digital form to data signals in analog 

form; and 

supplying the data signals in analog form to subpixels of the display device for 
5 displaying the portion of the image represented by said subpixel data elements of said group. 

8. The method of claim 7, wherein circuitry integral to the display device performs 
said digital-to-analog conversion and supplies the data signals in analog form to subpixels of the 
display device. 

9. The method of claim 1 , wherein display logic of a display subsystem operatively 
10 coupled to said display device: 

provides said luminance data in digital form; 

provides said group of subpixel data elements representing color of a portion of 

said image; 

modifies said intensity values for said subpixel data elements in said group based 
15 upon said luminance data; and 

outputs said modified intensity values for said subpixel data elements of said 
group for- display on said display device. 

10. The method of claim 1, wherein each step is performed by application software 
executing on a computer system. 

20 11. The method of claim 1, wherein said subpixel data elements representing said 

image are logically partitioned into an array of rows and columns. 

12. The method of claim 10, wherein said group of subpixel data elements comprise a 
pair of data elements in one of the rows of the array. 

13. The method of claim 10, wherein said group of subpixel data elements comprise a 
25 pair of data elements in one of the columns of the array. 
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14. The method of claim 10, wherein said group of subpixel data elements are 

elements of full pixels which comprise a 2x2 quad block of data elements in the array. 

1 5 . The method of claim 1 , wherein said modifying step further comprises reducing 
perceptible variance in luminance over different viewing angles with respect to the display of the 

5 image. 

16. The method of claim 1, wherein said modifying step further comprises reducing 
perceptible variance in color over different viewing angles with respect to the display of the 
image. 

1 7. A programmable storage device readable by a digital processing apparatus and 

1 0 tangibly embodying a program of instructions executable by the digital processing apparatus to 
perform method steps for generating an image for display on a display device having a plurality 
of subpixels, the method steps comprising: 

providing luminance data, in digital form, which associates intensity values with 
corresponding luminance values characterizing luminance of said subpixels in at least one 
1 5 viewing angle direction for a range of said intensity values; 

providing a group of subpixel data elements representing color of a portion of said 
image, wherein each ofsaid subpixel data elements comprises an intensity value; 

modifying said intensity values for said subpixel data elements in said group 
based upon said luminance data to reduce the number of said subpixels that have a luminance 
20 value in a range of mid-tone luminance values between a bright luminance value and a dark 
luminance value; and 

outputting said modified intensity values for said subpixel data elements of said 
group for display on said display device. 

18. The programmable storage device of claim 17, wherein the modifying step further 
25 comprises the sub-steps of; 
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storing, in a first memory, a plurality of entries each providing an association 

between an intensity value and a corresponding luminance value characterizing luminance of said 

subpixels in at least one viewing angle direction; 

storing, in a second memory, a plurality of entries each providing an association 
5 between a target intensity value and a corresponding set of intensity values that are above and 
below said target intensity value; 

identifying particular luminance values stored in said first memory that 
correspond to intensity values of said subpixel data elements of said group; 

generating a first luminance value based upon the particular luminance values 
1 0 stored in said first memory; 

identifying a first target intensity value stored in said first memory corresponding 
to said first luminance value; 

identifying a particular set of intensity values stored in said second memory that 
correspond to said first target intensity value; and 
1 5 modifying intensity values for said subpixel data elements in said group based 

upon said particular set of intensity values. 

19. The programmable storage device of claim 18, wherein said subpixel data 
elements in said group are elements of full pixels which are adjacent to each other in said image. 

20. The programmable storage device of claim 1 8, wherein said first luminance value 
20 is derived by calculating an average luminance value of the particular luminance values stored in 

the first memory. 

21 . An apparatus for generating an image for display on a display device having a 
plurality of subpixels comprising: 
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a first memory wherein luminance data, in digital form, which associates intensity 

values with corresponding luminance values characterizing luminance of said subpixels in at 

least one viewing angle direction for a range of intensity values are stored; 

a second memory wherein a group of subpixel data elements representing color of 

5 a portion of said image, wherein each of said subpixel data elements comprises an intensity value 

are stored; and 

an intensity controller which modifies said intensity values for said subpixel data 
elements in said group based upon said luminance data to reduce the number of said subpixels 
that have a luminance value in a range of mid-tone luminance values between a bright luminance 
10 value and a dark luminance value. 

22. A computer, comprising: 

a display device which displays an image; and 

a processor which provides data to said display device, wherein said data is 
configured to control said display device in order to display said image, and wherein said data is 
15 configured so that said image is displayed as: 

a plurality of subpixels logically partitioned into a first category and a second 
category, wherein: 

_ the first category of subpixels are supplied with a data signal of a first polarity, 
the second category of subpixels are supplied with a data signal of a second 
20 polarity opposite said first polarity, and 

the subpixels are partitioned to reduce perceived flicker in the displayed image; 
and wherein: 

the subpixels correspond to data elements representing color of at least a portion 
of said image, wherein each of said data elements comprises an intensity value, and wherein said 
25 intensity values have been modified to reduce the number of said data elements having a 
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luminance value corresponding to said intensity value in a range of mid-tone luminance values 

■ 

between a bright luminance value and a dark luminance value. 

23 . The computer of claim 22, wherein said data elements representing said image are 
logically partitioned into rows and columns. 
5 24. The computer of claim 23, wherein each of said subpixels corresponds to a data 

element representing a particular color in a group of two or more colors, and wherein a full pixel 
comprises subpixels corresponding to the colors of said group. 

25. The computer of claim 24, wherein said subpixels corresponding to said modified 
intensity values are arranged in pairs of subpixels, and wherein for each pair of subpixels, the 

1 0 luminance of a first subpixel of said pair of subpixels is brighter than the average luminance of 
said pair of subpixels and the luminance of a second subpixel of said pair of subpixels is darker 
than the average luminance of said pair of subpixels. 

26. The computer of claim 25, wherein said pattern has a periodicity of 2 full pixels 
along said rows and 2 full pixels along said columns, and wherein said pair of subpixels are 

1 5 elements of full pixels which are adjacent to each other in said image. 

27. The computer of claim 26, wherein for each full pixel comprising subpixels 
corresponding to said modified intensity values, said subpixels comprising said full pixel are one 
of said second subpixels of said pair of subpixels and said first subpixels of said pair of 
subpixels. 

20 28. The computer of claim 25, wherein said pattern has a periodicity of 2 full pixels 

along said rows and 4 full pixels along said columns, and wherein said pair of subpixels are 
elements of full pixels which are adjacent to each other in said image. 

29. The computer of claim 28, wherein for each full pixel comprising subpixels 
corresponding to said modified intensity values, said subpixels comprising said full pixel are one 
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of said second subpixels of said pair of subpixels and said first subpixels of said pair of . 

subpixels. 

30. * The computer of claim 25, wherein said pattern has a periodicity of 4 full pixels 
along said rows and 2 full pixels along said columns, and wherein said pair of subpixels are 

5 elements of full pixels which are adjacent to each other in said image. 

3 1 . The computer of claim 30, wherein for each full pixel comprising subpixels 
corresponding to said modified intensity values, said subpixels comprising said full pixel are one 
of said second subpixels of said pair of subpixels and said first subpixels of said pair of 
subpixels. 

10 32. The computer of claim 30, wherein said subpixels corresponding to said modified 

intensity values are arranged in adjacent couples comprising one of said second subpixels of said 
pair of subpixels and said first subpixels of said pair of subpixels. 

33 . The computer of claim* 25, wherein said pattern has a periodicity of 2 full pixels 
along said row and 2 subpixels along said column, and wherein said subpixels are arranged in 

15 rows alternating between a first row of adjacent couples comprising said first subpixels of said 
pair of subpixels, separated by one of said second subpixels of said pair of subpixels and a 
second row of adjacent couples comprising said second subpixels of said pair of subpixels, 
separated by one of said first subpixels of said pair of subpixels. 

34. The computer of claim 33, wherein said first and second rows comprise adjacent 
20 couples of blue and red subpixels separated by one green subpixel. 

35. The computer of claim 33, wherein said first and second rows comprise adjacent 
couples of blue and green subpixels separated by one red subpixel. 

36. The computer of claim 33, wherein, said first and second rows comprise adjacent 
couples of green and red subpixels separated by one blue subpixel. 

25 
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